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HREE INFLUENCES stimulated the 

present study: (a) the intensive de- 
mand for more and better psychiatric 
services, (b) the attempts to formulate 
new systems of psychotherapy, and (c) 
the very recent but increasing efforts to 
establish objective criteria for the evalua- 
tion of therapeutic endeavors. Specifi- 
cally, this study is concerned with an ex- 
ploration of certain of the theoretical 
and practical problems involved in the 
measurement by means of a structured 
personality inventory of therapeutically 
induced changes in personality. 


Psychiatry is currently experiencing a period 
of intense activity which is in direct response to 
the demands for therapy of the numberless 
personality disorders of all degrees engendered 
in civilian and veteran populations alike by the 
emotional stresses of World War II (1). With the 
addition of the personal maladjustments orig- 
inating under the pressure of the emergency 
years to the pre-war case load, it is natural that 
the interest and contributions of the government 
and the public should be in the direction of 
increasing the number and quality of centers 
for the training of more clinicians. The approxi- 
mately 4000 psychiatrists and 800 clinical psychol- 
ogists now listed on the rolls of their respective 
organizations cannot, in point of numbers, han- 
dle in anything approaching adequate fashion 
the prophylactic and therapeutic needs of the 
population. Estimates have placed the number 
of psychiatrists required in certain areas at from 
four to seven times the number now available 
(5). It was primarily to remedy the dearth of 
adequately trained personnel that the National 
Mental Health Act was passed in 1946. Under 
the provisions of this act, the United States Pub- 
lic Health Service is directing and subsidizing 


* This paper is a part of a thesis submitted to 
the Department of Psychology of the University 
of Minnesota in partial fulfillment of the re- 
quirements for the degree of Doctor of Philos- 
ophy, June, 1948. 
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CHAPTER I 


INTRODUCTION 


an extensive program to improve training facili- 
ties in psychiatry, clinical psychology, and psy- 
chiatric social work and to increase the number 
of trainees in these fields. 

It is necessary, though difficult, in the midst of 
practical considerations and the exigencies of 
daily service to attempt a long view. Some work- 
ers 2lready have expressed doubt as to the ulti- 
mate validity of the present emphasis on train- 
ing. Kubie suggests that there is a fallacy in the 
theory that the training of more workers will 
suffice to improve the psychiatric health of the 
community or nation, at least as measured in 
terms of the number of patients (12). He points 
out that increased availability of services invar- 
iably leads to increased demand, so that the 
“catching up” point is never reached. An ob- 
viously crucial factor in determining the pa- 
tients-per-therapist ratio is the effectiveness of 
the remedies available to the clinician. Not only 
must more workers be trained, but their training 
and therapeutic armamentarium must be en- 
hanced by new techniques of proven efficacy. 
The development and testing of new techniques 
of therapy demand a research orientation, and 
research programs must not be grossly subor- 
dinated to the construction of curricula if psy- 
chiatry is to derive maximum benefit from the 
advantage it now enjoys under the triple in- 
centives of social need, favorable public opinion, 
and government funds. 

It is fortunate that the effective relationships 
which were established between psychiatry and 
clinical psychology in the armed services show 
promise of being maintained. Clinical psychol- 
ogy also is benefiting from government subsidi- 
zation and while this support is, again, primarily 
to increase the number of trainees in this field, 
it may be hoped that a direct impetus to research 
will result. 

It is only through the medium of research, 
supported and conducted by all professional 
workers concerned with the treatment and pre- 
vention of psychiatric disorders, that we may 
hope to achieve the construction and sharpening 
of those diagnostic, prognostic, and evaluative 
instruments which are necessary to assure the 
most efficient application of such facilities as 
are available for the care of personality dis- 
turbances at all levels of their manifestations. 
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What are the most pressing research 
needs in the field of mental health from 
a long-term view? First of all, there is a 
need for research which will establish in 
a definitive manner the level of effective- 
ness of existent therapies with respect to 
specifically diagnosed disorders. Sec- 
ondly, there is a need for research which 
will establish the validity of newly pro- 
posed therapies. Inherent in researches 
of this type is the specific problem of 
determining which patients improve, 
and how much they improve, and which 
patients do not improve under a given 
regimen. The solution of this problem is 
contingent upon the attainment of a 
standard, objective, representative evalu- 
ation of the status of an individual's per- 
sonality. 

This paper presents an investigation of 
some of the problems arising in the 
application and interpretation of such 
evaluations, particularly as they furnish 
data on the effectiveness of given thera- 
pies. 

The histories of the major psychiatric 
therapies have followed a certain pat- 
tern. In brief, there has been an initial 
enthusiastic announcement of the new 
technique accompanied with or followed 
shortly by figures on recovery which have 
represented not merely a sizeable im- 
provement over those for earlier thera- 
pies but which have approached the 100 
per cent point so closely as to suggest a 
specific cure. Later reports on the tech- 
nique from other clinics and sometimes 
from the clinic of origin have shown con- 
siderably lower frequencies of recovery. 
Thus, Sakel in first publishing on insulin 
shock therapy of schizophrenia claimed 
87.9 per cent remissions. This figure has 
not been duplicated by any other work- 
ers. 

There are undoubtedly many factors 
involved in the explanation of diver- 


gences between comparable figures for 
recovery rates in two clinics as well as for 
the failure of originally very high rates 
of remission in a given clinic to be main- 
tained in further studies. A considerable 
part of divergence in interclinic statistics 
is probably due to differences in the sys- 
tems (or lack of system) by which the 
status of patients is evaluated both be- 
fore and after a course of therapy. Most 
commonly such evaluations are char- 
acterized by subjectivity, with little con- 
cern that the evaluation of the patient 
before and after therapy be on the same 
schedule of variables (3). In extreme 
form, this type of evaluation of a pa- 
tient’s progress is expressed in terms of 
the facts that his diagnosis at time of ad- 
mission to the hospital was “schizo- 
phrenia—paranoid type” and that he was 
noted at time of discharge to be free of 
hallucinations. There would be many 
observations and facts concerning the 
patient which went “into” the diagnosis 
and yet which, in the form of a diagnosis, 
would not be available as a basis for 
evaluating his status when discharged. 
Likewise, there could be many observa- 
tions concerning the patient at the time 
of discharge which would be relevant to 
predictions of his adjustment at home 
and at work and yet which would not be 
properly weighed and communicated by 
recording only that his hallucinatory be- 
havior had ceased. Evaluations of this 
gross type permit recognition of the most 
obvious degrees of improvement, i.c., 
abatement of severe symptomatology, but 
they are not sufficient for detection of 
improvement in the patient’s personality 
with respect to those inadequacies in s0- 
cial adjustments and diurnal habits 
which served as the first clues to his ill- 
ness. From this point of view, the maxi- 
mal efficacy of a given therapy for a 
given patient could not be ascertained at 
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the time of his discharge from the hos- 
pital but only after he had returned to a 
normal, non-institutional environment 
and only in terms of the quality of his 
adjustments in that environment. Fur- 
thermore, the observations and evalua- 
tions of his post-therapy behavior would 
have to be ordered to the same method 
of recording as was used to depict his 
status prior to therapy. Limitations of 
time and money have generally pro- 
hibited the attainment of this ideal para- 
digm for the validation of a therapeutic 
procedure. The next best approach de- 
mands that the status of the individual 
be thoroughly measured in terms of such 
observations as are possible immediately 
prior to the start of a course of therapy 
and immediately upon the completion of 
that course. It is equally important in 
this more circumscribed evaluation of 
the patient’s progress that his status be- 
fore and after therapy he measured with 
respect to the same variables. 

It may be argued that no matter how 
rigorous the procedure of investigation, 
the “pure” effects of shock therapy, for 
example, may not be determined since 
such therapy is always imbedded in a 
certain setting and adminstered by per- 
sonnel whose effects on the patients can- 
not be held constant. It may further be 
argued that the effects assignable to 
shock are inextricably mixed with the 
effects of the less dramatic psychothera- 
peutic efforts of the physician. With re- 
gard to this last point, it must be recog- 
nized that the ancillary therapeutic pro- 
grams developed for the patient receiv- 
ing convulsive therapy are probably as 
diverse as the theories proposed to ex- 
plain the mechanics (or dynamics) of 
shock as therapy. This source of dis- 
crepancy should be remembered when 
it is necessary to explain different meas- 
ured effects in different clinics when the 


CHANGES IN MMPI RESPONSES FOLLOWING CERTAIN THERAPIES 


same (?) therapy has been applied. 

With regard to the complicating effects 
of other psychotherapeutic ‘efforts (e.g., 
interviews) accompanying a major medi- 
cal therapy, it should be recognized that 
the clinic in which the decision to apply 
a convulsive therapy is not accompanied 
by a reduction (either planned or un- 
planned) in the number of hours spent 
by the physician in personal contacts 
with the patient is probably rare. When 
a gross procedure of the nature of electro- 
shock seems a promising approach with 
a given patient, the therapist probably 
feels some justification in reducing his 
contacts with that patient so as to af- 
ford more hours to those patients for 
whom no “specific” therapy is available. 
In short, the effects of a therapy such as 
electroshock are probably open to evalu- 
ation in a more pure form than would at 
first appear to be the case. 

The design and carrying hia of 
investigations of the above nature must 
necessarily await the development of ade- 
quate techniques for the thorough de- 
scriptive assay of the individual person- 
ality. It has been only within the last 
decade that clinical psychology has of- 
fered an instrument having the essential 
virtues of psychiatrically oriented vari- 
ables empirically validated and quantita- 
tively expressed. This instrument is the 
Minnesota Multiphasic Personality In- 
ventory (8, 9).? This psychiatric inventory 
was designed primarily to furnish an ex- 
ternal, objective source of information 
bearing on the detection and diagnosis 
of personality aberrations. In addition to 
four scales which indicate the validity of 
the subject’s record, the MMPI measures 
personality deviations on nine clinical 
scales: Hs—hypochondriasis, D—depres- 


* The Minnesota Multiphasic Personality In- 
ventory will be referred to hereafter as the 
MMPI. 
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sion, Hy—hysteria, Pd—psychopathic de- 
viate, Mf—masculinity-femininity, Pa— 
paranoia, Pt—psychasthenia, Sc—schizo- 
phrenia, and Ma—hypomania. 

The validity measures are the “Cannot 
Say,” L, F, and K scale$. The first of these 
is simply the number of items placed in 
the “Cannot Say” category. Since the 
“Cannot Say” responses are not scored 
on any of the other scales, a large num- 
ber of such responses has a generally sup- 
pressing effect on the clinical profile. 
The L scale is composed of fifteen items 
designed to measure the strength of the 
subject’s tendency to “fake good” by 
selecting responses which place him in a 
socially acceptable light. The F scale is 
composed of items the scored responses 
to which are extremely infrequent; ele- 
vated F-scores may occur as a result of 
errors in scoring, carelessness or lack of 
comprehension by the subject, or a “fake 
bad” tendency in the subject. The K 


scale is the most recent of the validity 
scales and provides a measure of the de- 
gree to which “defensiveness” has char- 


acterized the subject’s test-taking atti- 
tude. 

The wide use of the MMPI by psychia- 
trists, clinics, and general physicians at- 
tests to its success in a diagnostic role (2, 
15). It is interesting to note that only 
recently has there been a sign of appre- 
ciation of its potential value in measur- 
ing the effects of a given course of ther- 
apy (7, 15, 16). That there should be such 
a lag in the use of a basically diagnostic 
instrument for the evaluation of change 
reflects a general failure on the part of § 
psychiatrists and psychologists to recog- 
nize that the determination of the pa- 
tient’s condition at any time after hos. 
pitalization or the onset of therapeutic 
interviews cannot be usefully made ex- 
cept on the very same variables the assess- 
ment of which served as the basis for 
hospitalization or the onset of therapy. 
The clinician should be no less willing to 
accept supportive information for his 
post-therapy evaluation than he was to 
seek assistance in the original problem of 
diagnosis. 
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HE MAJOR ASSUMPTION underlying 
T the investigation reported here is 
that an instrument of demonstrated 
validity in the measurement of personal- 
ity deviations of psychiatric import is of 
equal validity for the evaluation of per- 
sonality changes and of the therapeutic 
operations deemed responsible for those 
changes. It is not assumed, however, that 
a direct evaluation of change in _per- 
sonality, or of the efficacy of a therapy, 
is possible through the single study of 
score changes. Rather, it is believed nec- 
essary to determine whether there are 
patterns of change in scores on a multi- 
variable instrument which are character- 
istic for given patients under given 
regimens and to discriminate, on as 
objective a basis as possible, between 
those changes in the personality assay 
which are therapy-related and _ those 
which are merely chance. Further, it is 
believed necessary to evaluate the extent 
of the relationship between changes in 
item response and associated score 
changes. 

In the event that an individual com- 
pletes a personality questionnaire such 
as the MMPI on two different occasions, 
certain analyses may be made of any dif- 
ferences which are observed in the result- 
ing profiles. It may be asked if the two 
profiles differ in a degree which would 
appear to approach significance. More 
specifically, this question relates to 
whether the two scores obtained on each 
single scale of the profiles differ by such 
an amount as exceeds that for which the 
hypothesis of no true difference (be- 
tween the means of hypothetical popula- 
tions of first-profile and second-profile 


CHAPTER II 


PURPOSE, SUBJECTS AND PROCEDURES 


scores) is tenable. For simplicity in refer- 
ence, this is the problem of status-score 
change. The observed differences be- 
tween the various pairs of status-scores 
constitute change-scores. 

There is still another kind of change 
not yet extensively considered, perhaps 
because attention to status-score changes 
has tended to mask the operation of this 
more subtle, but potentially significant 
variation from profile to profile. This is 
the change in response to specific items 
composing the various scales; it may be 
referred to as item-response change. 

The purpose of this investigation has 
been to study the item-responses on the 
MMPI of certain groups of persons and 
the changes in the item-responses of 
these persons as a result of the passage 
of time plus the occurrence of certain 
events. More specifically, it has been de- 
signed to study the nature of changes 
in the responses to the MMPI items of 
certain groups of psychiatric patients 
and the relationships between item-re- 
sponse changes and status-score changes 
in these groups, and it has been oriented 
toward the problem of detecting and 
measuring therapy-induced changes in 
personality. 

The investigation began with a careful 
check of the approximately 7000 records 
in the MMPI research files at the Uni- 
versity of Minnesota to obtain the names 
of all persons, normals and patients, to 
whom the inventory had been adminis- 
tered on at least two occasions. For all 
cases, available information on educa- 
tion, occupation, marital status, place of 
residence, etc. was recorded in addition 
to the interval, to the nearest 5-day unit, 
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between the two administrations of the 
MMPI. No in-patients were included in 
the study unless a check of their hospital 
record revealed that they had been dis- 
charged “improved” or “recovered” and 
that the two MMPI profiles had been 
obtained within the limits of a single 
hospitalization, and the length of this 
hospitalization was recorded in addition 
to the above information.’ The hospital 
charts of the patients were also checked 
carefully to determine the exact nature 
of the therapy which the patient had re- 
ceived, and particular note was made of 
the use of electroshock. 

A post-admission MMPI is obtained 
routinely on all patients admitted to the 
Psychopathic Unit of the University of 
Minnesota Hospitals. With the begin- 
ning of this study in September, 1946, a 
special effort was made to collect post- 
therapy, pre-discharge MMPI records on 
all patients. Most of the patients com- 
prising the “psychotic-shock” group for 
this study were obtained in this manner. 

The Psychopathic Unit has a total of 
only 35 beds of which six are in a sepa- 
rate ward for grossly disturbed patients. 
While the number of beds available to 
men and women patients on the general 
psychiatric ward are approximately equal, 
the actual number of women hospitalized 
per year greatly exceeds the number of 
men.’ Due to lack of an adequate num- 
ber of male patients for whom two rec- 
ords are available, the present study 
deals entirely with females. 

The normal cases fall into two groups: 
the first is composed of nineteen female 
night-school students, half of whom took 

*In the case of the out-patients included in 
this study, the number of visits to the Out- 
patient Psychiatric Clinic between the two 
MMPIs was recorded. No evaluation of “im- 
provement” in these patients was available. 


*In 1947, the Psychopathic Unit treated a total 
of 180 female and 123 male in-patients. 
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the individual form of the MMPI first 
and one week later took the group form, 
the other half taking the two forms in 
reversed order with a one-week interval 
between them.’ The second group is 
composed of 23 females selected from the 
files because they had two MMPI rec. 
ords. The mean interval between the two 
tests for this second group was 136.4 
days; the median interval was 47.5 days. 
This indicates the marked positive 
skewness which characterized the distri- 
bution of inter-test intervals. The mean 
age of the first group was 32.1 years, 
with a standard deviation of 7.3; the 
mean age of the second group was 26.3 
years, with a standard deviation of 4.4. 
The difference in the mean ages of the 
two groups is not significant (t = .g98) 
nor is the difference in the variances sig- 
nificant (F = 2.727). The MMPI test 
and retest means and standard deviations 
for the two normal groups are given in 
Table 1. Only one of the test-retest dif- 
ferences in mean score is statistically sig- 
nificant; this difference occurs on the Pt 
scale in the night-school sample (¢ = 
3.35; P< .o1). The test-retest correla- 
tion for the Pt scores in this group is 
.783, the highest of such correlations in 
this group for any of the clinical scales. 
If we may assume, on the basis of the 
very marked tendency in both groups of 
normals for the second test means on the 
clinical scales to be lower than the orig: 
inal means and on the basis of similar 
findings in other studies which have indi- 
cated a tendency for the “adjustment 
scores” of normals to change in the direc- 
tion of improvement, that there exists an 


* These cases were originally included in 4 
study to determine the equality of the group 
and individual forms. No significant differences 
were found between the mean scale scores ob- 
tained with the two forms, The writer is in- 
debted to Dr. Howard P. Longstaff for the data 
from these cases. 
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TABLE 1 


TEST AND RETEST MEANS AND STANDARD DEVIATIONS OF THE MMPI Scores OF THE 
Two Groups or NoRMALS* 


Group 


Night- 9. o: a 2 8. ‘ 
File- I 20.4 17. Beg 5.0 46.3 47.0 I 
random 9 20. 6 2.0 2.4 1.8 °o 7. 


Night- I 52.1 6.8 54.0 8.8 53.8 10.2 52.1 6.6 53.1 7.5 51-4 8.2 
school 2 7:8 9:2. 9.9 48.7 6.8 . 52.8. . 49:0 . 8.7 
File- I 8.6 49.6 7.2 go.2 8.6 47.8 7.29 97.8. 43.4. 9-4 
random 2 48.2 8.4 49.2 8.5 51.0 7.0 47.2 7.8 50.7 6.2 49.2 10.8 


* The MMPI data in this and all subsequent tables are based on T-scores derived from the usual 


formula: 


X-—M 
T =50+10——— 


except for the data for the ‘‘?,’’ L, and F scales which are in raw score units. 


as yet unanalyzed factor making for a_ night-school students is offered in the 
regression toward the norm in the per- absence of evidence of any more obvious 
sonality measure of normals, even in the factor which might account for the ob- 
absence of originally extreme scores, served difference. It will be noted from : 
then the appearance of such a factor Table 2, which presents a summary of 
would be maximized in the test-retest descriptive statistics for the normal and 
differences of those scales having the clinical groups, that the combined nor- 
greatest reliability. This explanation of mal group is’characterized by a high in- 
the change on the Pt scale shown by the cidence of individuals with high school 


TABLE 2 
GENERAL DEscrIPTIVE STATISTICS FOR THE FIVE SAMPLES TESTED 


Age Days in Hospital» between 


Group* Number Te 
Mean’ Range Mean’ Range Mean Range Single H 
Normals 42 28.9 21-46 61.6  2-1060 78.6 95.0 
OPD 25 92.2 17-56 5.8 2-18 80.6 5-330 32.0 63.2 
PN 24 26.9 17-39 52.0 20-114 33-4 5-75 41.7 34.8 
PS-NS 13 35.8 20-57 64.4 15-106 33-8 5-65 38.5 30.8 
PS-S 20 43.2 20-59 50.6 23-90 27.2 5-40 30.8 83.3 


* out-patients. 
PN—24 hospitalized neurotics. 
PS-NS—13 hospitalized psychotics who received neither insulin nor electroshock therapy. 
PS-S—20 hospitalized psychotics treated with electroshock. 

> The a in this column for the OPD group refer to number of clinic visits in the interval between 

the two MMPIs. 

* Percent of group with high school education or better. 
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education or better, from metropolitan 
areas. 

The clinical groups are four in num- 
ber: 25 out-patients; 24 hospitalized neu- 
rotics; 13 hospitalized psychotics who did 
not receive any type of convulsive thera- 
py; and 20 psychotics who received elec- 


TABLE 3 


THE COMPOSITION OF THE CLINICAL GROUPS 
BY DIAGNOSIS 


Num- 

Group Diagnosis oor 
OPD Psychoneurosis (mostly mixed). .| 22 
N=25 | Schizophrenia, simple.......... I 
I 
PN Psychoneurosis, mixed......... 13 
N=24 
hypochondriasi 2 
psychasthenia..| 1 

reactive depres- 

4 
PS-NS | Manic-depressive, depressed. . . $ 
I 
Agitated depression............ I 
Schizophrenia, simple.......... I 
catatonic........| 1 
Recurrent depression...........| 1 
Psychosis, undiagnosed......... 3 
PS-S Manic-depressive, depressed....| 4 
N =20 | Involutional, melancholia.......| 8 
ebephrenia.... . I 
undetermined....| 1 
Paranoid condition. ........... 2 


troshock therapy. Table 3 presents the 
composition of the clinical groups by 
diagnosis. 

The two MMPI records of each sub- 
ject were tallied on a common form in 
such a way as to indicate the actual re- 
sponse (“True,” “False,” “Cannot Say’’) of 
the subject to each item on each of the two 
testings. From these combined records, it 
was possible to determine for each indi- 
vidual the total number of changed re- 
sponses, the number of changes by direc- 
tion of change, and the number of 
changes per general type of item. These 
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data for the individuals were then com- 
bined to permit determination of group 
Statistics. 

The mean score of each group on each 
of the validity and clinical scales of the 
MMPI was determined for the first and 
second tests and the reliability of the 
differences between the test and retest 
means of each group was determined 
by statistical analysis. 

The inter-group differences in the 
means and variances for the number of 
item-responses changed per individual 
were tested for reliability as were the 
inter-group differences in means and 
variances for the number of responses 
changed per item. 

In order to study the relationship of 
item-response changes to changes in sta- 
tus-scores, the total change-score, i.e., 
change in status-scores, for each individ- 
ual was determined by adding, without 
regard to sign, the differences between 
his test and retest scores on the clinical 
variables. The ratio of this total change- 
score (Xcs) to the number of items 
changed (Sic) was determined for each 
individual and summary statistics for 
this ratio (Scs/Sic) were determined for 
each of the groups. 

Finally, item-by-item comparisons 
were made to determine the reliability 
of the differences between the per cent of 
responses changed by the normal group 
and each of the clinical groups respec- 
tively. Lists of items with reliable differ- 
ences in frequency of change were com- 
piled and studied to determine if they 
showed any dominant characteristics. 

In view of the small N for each of the 
patient groups, the present study can 
only be considered as exploratory rather 
than definitive, a search for support or 
refutation of specific hypotheses, rather 
than a basis for final establishment of 


conclusions. 


A. MEAN PROFILES FOR THE NORMAL AND 
CLINICAL GRouPS 


HE MEANS and standard deviations 
Tos each of the groups on each of 
the validity and clinical scales of the 
MMPI, for both administrations of the 
inventory, are given in Table 4. The cor- 
responding profiles are presented in 
Figures 1-5. 

The significance of the difference be- 
tween the first and second administra- 
tion means for a given scale in a given 
group was tested by the following for- 
mula: 


Mi—2.M 
(=D)? 


= 


where D = the difference between the 
first and second scores of a given indi- 
vidual. Only those differences have been 
considered reliable which yield a “t” 
score with a probability of less than 1 per 
cent, 

It will be noted with respect to the 
clinical variables that there is a general 
tendency for the mean scores on the 
second administration to be lower than 
those for the first. Exceptions to this 
occur on the Pd scale in the out-patient 
(OPD) group, on the Mf scale in the hos- 
pitalized neurotic (PN) group, and on 
the D and Hy scales in the psychotic pa- 
tients who did not receive electroshock 
therapy (PS-NS). None of the mean 
score differences of the combined Nor- 
mal Group is statistically significant nor 
is any of the OPD group. The mean F- 
score difference in the Normal Group has 
a P of < .o2. 


CHAPTER III 


RESULTS 


In the PN group, the second test 
means on the Hs, Hy, and Pd scales are 
significantly lower than the original 
means (P < .01 in each case). 

The PS-NS group shows no significant 
mean differences on any of the clinical 
scales, The difference between the two 
K-score means is significant at the 1 per 
cent level. 


The sample of psychotic patients who 


_received electroshock therapy (PS-S) 


shows a reliable decrease of mean score 
on the Hs, D, Hy, Pd, Pt, and Sc scales. 
The mean difference on the Pa scales has 
a probability of less than 2 per cent. 

With respect to the validity scales, it 
should be noted that there is a consistent 
tendency for the F-score mean to be 
smaller on the second test, while the re- 
verse holds for the K-score except for 
the PS-S group. None of the mean differ- 
ences for these two variables is reliable, 
however. 

From Table 2, it may be seen that the 
Normal Group is characterized by a 
higher proportion of single persons and 
persons with a high school education or 
better than characterizes the clinical 
groups. From Fig. 1 and Table 4, it 
appears that these selective factors have 
not unduly influenced the “normality” 
of this group insofar as the clinical scales 
of the MMPI are concerned. The two 
profiles follow the 50-score line closely 
and there is not the elevation on the Hy- 
scale to be expected in a college group. 
Furthermore, the test-retest reliabilities 
for the various scales in the combined 
normal group closely approximate those 
reported for normals in the literature. 

In working with personality scores in 
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TABLE 4 


TrEst-RETEST MEANS AND STANDARD DEVIATIONS FOR THE SCORES OF EAcH GROUP ON THE 
MMPI, witu SIGNIFICANCE TESTS FOR THE MEAN DIFFERENCES* 


L K 

Group Test 

M M M o M M o 
Normals I 17.0 15.2 6:4 3.3 56.6 8.3 47.1 6.0 49.0 9.8 
N =42 2 19.8 19.9 $.6 57-8 8.3 45-7 47.0 7.7 
OPD I 19.0 4-4 %2 51.3 9.0 74.4 13.4 
N =25 2 8.0 4.2 1.6 6:2 3.4 52.4 8.2 12.6 9.0 
PN I 14.2 18.6 4-6 2.6 52.2 9.8 74.9 13.4 . 8.5 
N=24 2 11.6 12.4 <3. 824 5.2 §.0 53-4 8.5 66.5 12.4 67.6 9.7 
PS-NS I 27.4 23.4 on 10.9 9.4 44.6 58.6 13.3 $4.9 
N=13 2 11.4 9-3 4-5 6.6 6.7 .6 57.8 11.2 
PS-S I 14-4 13.6 ey 8.2 6.0 s2.% 9.8 62.8 10.7 74-4 10.8 
N =20 2 23.0 23.4 3.9 2.0 4.0 a8 50.7 6.9 53.0 12.8 58.2 9.1 


Normals 1.4 8 2. 
OPD 2.0 8 
PN 1.4 1.0 

PS-NS 2.4 1.6 I 
PS-S 1.7 1.8 3. 


The data for the ‘‘?,”" L, and F scales are in raw score units. Those for the remaining scales are in T-score units. 
b The N’s on which the means and standard deviations for the Mf score are based are: OPD = 20; PN =13; PS-S = 20. 


* Significant at the 1% level. 


which deviation is permitted in one di- 
rection only, in which experience with 
like measures indicates a general phe- 
nomenon of regression in the direction of 
“normality” (i.e., lower scores) with a 
simple passage of time, and in which the 
expected direction of change for patients 
receiving specialized therapy is toward 
lower scores on a retest, we would ex- 
pect the retest scores of patients to show 
a reduced range and to find this reduced 
range reflected in lower test-retest corre- 
lations than are found with normals 
tested over a similar interval. In general 
these expectations are borne out by the 
results in Table 5, which show a tend- 
ency for the test-retest correlations to be 
lower for the patient groups than for 


TABLE 5 
TEst-RETEST CORRELATIONS OF Group ON Eacu SCALE 


1.0 1.6 2.1 
7 2.0 +3 
.6 1.4 

3.0% 

1.0 


the normals. In view of this argument, 
it may be considered more proper to con- 
sider test-retest correlations in patients 
who have had therapy as indices, at least 
in part, of therapeutic efficacy rather 
than as reliability coefficients. The small 
size of the samples in this study precludes 
testing the significance of the differences 
between these coefficients but their 
values are reflected in the tests of the 
reliability of the differences in corre- 
sponding means since they enter into the 
determination of the standard error of 
the difference between means for the 
test and retest scores. In this respect, it 
should be noted that Darley (4) interpre- 
ted his test-retest coefficients, which were 
considerably lower than the corrected 


Group | 2 | L Hs | D | Hy | Pd | Mf | Pa | Pt Sc Ma 
Is (N = 42) -718 | .810 | .749 | .663 | .724 | .734 | .682 $69 -585 | | .783 
OPD (N =25) “430 -556 707 | .§80 | .657 | .424 | .664] .56 -827 | .367 | .708 -796 | .746 
PN ( ran 884 | .596 | .687 763 | .536| .570 | .617 | .605 | .589 | .408 | .475 -668 | .8190 
NS* (N =13) -334 | .852 375 105 | .220 | .707 | .436 | .375 -052 | .147 | —.303 | .608 

S (N =20) -434 | -555 | -384 | .353 | .908 | .486 | .555 | .431 | -343 | .580 | .406 660 | . 


* The coefficients for the PS-NS 


up are ‘r's’’ corresponding to computed “‘rho’s”’ as given in Table 
p. 362, Garrett, Statistics in Puideay and Education, 2nd edition. 
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TABLE 4—Continued 


51.6 8.0 51.6 8.2 51.8 g-s 49.8 7.2 52.6 7.6 49.8 9.0 
49.4 8.2 50.8 9.0 50.8 +2 47-9 7-4 51.0 7.2 49-r 9.8 
76.2 41.2 61.3 12.2 48.8 12.1 61.2 10.6 69.5 11.4 69.8 12.8 55.9 11.9 
73.1 12.4 66.2 14.8 48.8 9.8 59-7 9-4 -4 13.6 67.3 13.2 §5.0 10.5 
77.2 10.8 63.6 13.2 42.8 8.9 62.5 10.6 66.6 11.8 69.2 12.4 $5.2 12.7 
69.2 11.3 60.5 11.0 46.2 10.6 59.1 10.2 65.8 12.7 67.0 14.4 55.8 12.6 
62.0 12.0 58.8 14-4 70.0 12.3 66.2 11.4 70.0 16.3 59.0 18.0 
63.1 10.4 58.1 5 Oo 14.4 63.4 8.6 64.8 15.6 $3-3 17.8 
“5 72.0 15.8 49.4 10.0 70.2 14.2 70.9 17.2 72.2 109.7 §6.2 12.2 
49-4 9.2 2 wry 15.7 


odd-even reliabilities for his measures, as 
guages of “trait stability,” representing 
a non-reducible combination of actual 
change in his subjects plus errors of 
measurement. 

The similarity of the profiles for the 
OPD and PN groups (Figures 2 and 3) 
is notable. The pre- and post-therapy 
profiles for both of these groups show 
the general form which has been de- 
scribed as “typical” for neurotics (6). In 
terms of such typical profiles, the eleva- 
tion on the neurotic triad for these 
groups would suggest that they were 
composed of so-called “mild” psycho- 
neurotics. The height of the secondary 
elevation on the Pa, Pt and Sc scales, 
however, is greater than that to be ex- 
pected in mild psychoneurotics and sug- 
gests that both the out-patient and hos- 
pitalized groups were composed of rather 
severe problems. This might explain at 
least partially the ineffectiveness of the 
out-patient therapy in reducing the neu- 
rotic triad although the relatively small 
number of therapy sessions intervening 
between the two profiles (see Table 2) is 
undoubtedly a factor also. 


“Therapy” as provided by the OPD 
clinic requires definition. The patients 
have their most frequent and extensive 
contacts (for history-taking, therapeutic 
interviews, etc.) with “junior clerks.” 
These are junior medical students who 
are assigned to the psychiatric service 
for a ten;week period. In their OPD ac- 
tivity, they work in close alliance with 
the psychiatric residents and are super- 
vised by the senior staff psychiatrists and 
clinical associates. While the patients are 
seen regularly (weekly or bi-weekly) by 
the junior clerks, they are seen only oc- 
casionally by a staff psychiatrist. 

The rise in the mean Pd score of the 
OPD group, contrasted with the signifi- 
cant decrease in the same score for the 
hospitalized neurotics, presents an in- 
triguing problem of explanation. One 
hypothesis which might explain these re- 
lationships is based on the relative ‘‘so- 
cial acceptance” of the neurotic symp- 
tomatology experienced by the out-pa- 
tient versus the in-patient. In the case 
of the out-patient, the probing of the 
therapist to uncover possible conflictual 
material which might have an etiologic 
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9.7 
[1.0 
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Ficure 1. Mean test and retest profiles of the combined normals, (N = 42.) 
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Ficure 2. Mean pre-therapy and post-therapy profiles of the out-patients. (V = 25.) 
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Ficure 3. Mean pre-therapy and post-therapy profiles of the hospitalized neurotics. (N = 24.) 
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Ficure 4. Mean pre-therapy and post-therapy profiles of the psychotics who 
did not receive electroshock therapy. (N = 13.) 
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role and his apparent discounting of the 
gross symptomatology may result in a 
sensitizing of the patient to the quality 
of his social adjustments to the extent 
that, with later administrations of the 
MMPI, he becomes a “plus-getter’’ on 
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the therapist and patient alike may legit- 
imately note the progress of therapy in 
terms of the amelioration of gross symp- 
tomatology and there is less of the subtle 
pressure on the patient to continue to 
uncover interpersonal conflicts. 


H, Pa M Pe PB Se Ma 


110 
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Ficure 5. Mean pre-therapy and post-therapy profiles of the psychotics 
who received electroshock therapy. (N = 20.) 


those items of the Pd-scale which per- 
tain to family and social adjustments, 
while his neurotic symptoms are rela- 
tively unaffected. The lower mean scores 
on the L and Hy scales for the second 
administration of the MMPI to the OPD 
group, while not significantly different 
from the original means, are in accord 
with this hypothesis. 

In the case of the hospitalized neurot- 
ic both the severity of symptoms which 
justified intramural therapy and the fact 
that hospitalization occurred, mean that 


*The term “plus-getter” has been applied to 
those individuals with a specific motivation, 
conscious or otherwise, to put themselves in an 
unfavorable or socially undesirable light. 


This hypothesis is supported some- 
what by the data from Table g which 
shows the percentage of item responses 
changed for those items classified as per- 
taining to “family and marital” concerns 
(Category XI) to be less for the PN 
than for the OPD group. Conversely, the 
OPD group shows a tendency to smaller 
percentages of item-responses changed 
than the PN group for those items classi- 
fied as pertaining to general neurologic, 
cranial nerves, motility and coordination, 
and sensibility (Categories II, III, IV 
and V). 

It is interesting to note that with psy- 
chotic patients, the ordinary regimen of 
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the psychiatric ward in the absence of 
electroconvulsive therapy is not adequate 
to achieve a significant reduction of the 
mean scores on the psychotic scales. 
While all of the psychotic scales in Fig- 
ure 4 show reductions in mean score, 
there is a slight though not significant 
increase in the mean scores for the D 
and Hy scales. The relative “mildness” 
of the profiles plus the fact that these 
patients did not receive electroshock 
suggests that they were borderline or 
mild psychotics with extensive neurotic 
coloring and this fact may account for the 
apparent shift from psychotic to neurotic 
symptomatology. Concomitant with this 
shift, there is an increase in defensiveness 
or control as revealed in a mean K-score 
increase of 7.90 (t = 3.000, P < .01). 

Figure 5, which presents the two mean 
profiles for the group of psychotic pa- 
tients who received electroconvulsive 
therapy is of interest not only because 
of the marked changes it reveals but be- 
cause of the stability shown by the Mf 
and Ma scales. The stability of these two 
scales in a group which shows so much 
change on the other clinical variables is 
of great importance as evidence for the 
selective sensitivity of the MMPI in re- 
flecting therapy-induced changes. Had 
all of the MMPI scales shown signifi- 
cantly reduced means following electro- 
shock therapy, it might be argued that 
all that was being measured was a gross 
tendency to response-change as a result 
of the confusion and memory defects as- 
sociated with EST and that specific per- 
sonality changes were masked. The dif- 
ferential change reflected in the profiles 
of Figure 5 argues for the efficiency of 
the MMPI as an instrument for detect- 
ing the particular results of special thera- 
pies. 

In summary, the data on the mean 
pre- and post-therapy profiles reveals no 
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significant changes for the OPD group, 
reliable improvement in the Hs, Hy, 
and Pd scores for the sample of hospital- 
ized neurotics (PN), no significant 
changes for the psychotics who received 
no electroshock therapy (PS-NS), and re- 
liable improvements on the Hs, D, Hy, 
Pd, Pt, and Sc scores for the psychotics 
treated with electroshock (PS-S). 


B. Group DIFFERENCES IN THE FRE- 
QUENCY AND NATURE OF RESPONSE 
CHANGES 


Table 6 gives the mean per cent of 
responses changed per item for each of 


TABLE 6 


MEANS AND STANDARD DEVIATIONS FOR 
Per CENT oF RESPONSES CHANGED 


Group N M o 

Normals 42 14.0 10.0 

OPD 25 22.0 10.8 

PN 24 18.4 13.6 

PS-NS 13 30.6 13.2 

PS-S 20 30.6 13.4 
F-values 


Group OPD PN PS-NS-_PS-S 


Normals 1.1 1.8* 1.9* 1.8* 

OPD 1.6*. 1.6* 

PN 1.0 

PS-NS 1.0 
t-values 


Group OPD PN PS-NS__PS-S 


Normals 12.0* 


OPD 
PN 14.4* 14.0* 
PS-NS 


* Significant at 1% level. 


the groups. These values are the same as 
the per cent of all item-responses per 
group which are changed. The per- 


*Let i = no. of items, p = no. of persons in 
group, and c= no. of responses changed per item. 
Then the mean values of Table 6 are derived from 
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centage of responses changed by the 
normals agrees well with the lower limits 
of comparable values reported in the lit- 
erature. The percentage of responses 
changed in the two subgroups of normals 
were very similar (14.41 per cent and 
15.56 per cent). It should be noted that 
the OPD and PN groups not only show 
an increase in the per cent of responses 
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and PS-S groups are significantly greater 
than that for the PN group. The differ- 
ence between the means of the two psy- 
chotic groups is not reliable. An hypothe- 
sis suggested by the data of Table 6 is 
that neurotic and psychotic patients have 
specific frequencies of response change 
to the MMPI items which are signifi- 
cantly different from one another, signifi- 


TABLE 7 


PERCENTAGE DISTRIBUTIONS OF ITEM RESPONSE CHANGES IN Eacu Group ACCORDING 
TO DIRECTION OF CHANGE 


T to? 


4 


6. 


2 
z. 
5 


NN 


6.0 
4.6 
4-9 
3-3 


changed over that for the normals but 
that this per cent is practically the same 
for both of the therapy groups, the dif- 
ference between the two values being 
only 3.5 per cent. Likewise, the per cent 
of responses changed is nearly identical 
for the two psychotic groups and is twice 
that for normals, both the shock and 
non-shock treated psychotics changing 
approximately one-third of their re- 
sponses. The mean per cent of responses 
changed per item for the OPD group is 
significantly greater than that for the 
Normal Group. The significantly greater 
variances of the PN, PS-NS, and PS-S 
groups as compared to that of the nor- 
mals prevent testing of the significance 
of the differences among the related 
means. The mean values for the PS-NS 


cantly greater than that for normals, 
and relatively independent of the specific 
type of therapy they are receiving. 
Table 7 presents data on the frequency 
of response change in each of the groups 
studied in terms of the direction of the 
changed response. Two facts are immedi- 
ately apparent from this table. First of 
all, there appear to be no gross differ- 
ences among the groups in the direc- 
tional distribution of the response 
changes. For each group, the percentage 
of responses changed from “True” to 
“False” is within ten points of the per- 
centage of “False” to ‘““True” responses. 
Secondly, the percentage of response 
changes which involve directly opposite 
responses, i.e., from “True to False” or 
“False to True,” constitute, in all groups, 


e 
i 
Group | TtoF | FtoT | | ?toF 
Normal 37-3 33.8 M2 9.8 7.9 
OPD 42.2 43-7 4 2.2 5-3 
PN 46.5 40.4 7 3:2 Sit 
PS-NS 45-9 36.2 8 1.5 Q.1 
PS-S 40.6 40.2 4 6.1 425 
T to F | ? 
Group and to 
F to T TorF 
Normal 91.1 I 12.9 
OPD 85.9 9-5 
PN 86.9 8.2 
PS-NS 82.1 14.6 
PS-S 80.8 I 7.7 
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7o per cent or better of all changes. It 
may be noted that changes involving a 
shift from an originally uncertain atti- 
tude or introspection (as evidenced by a 
“Cannot Say” response) to a definitely 
positive or negative (“True” or “False’’) 
response constitute from 7.7 per cent to 
12.9 per cent of the response changes in 
the five groups. Since the number of 
“True” and ‘False’ responses on the first 
administrations of the MMPI constitute, 
on the average, 97 per cent of all re- 
sponses, with the remaining 3 per cent 
of responses in the “Cannot Say” cate- 
gory, it is clear from Table 7 that orig- 
inal “True” and “False” responses con- 
tribute a smaller proportion of the total 
of changed responses than would be ex- 
pected from the proportion they consti- 
tute of all original responses. On the other 
hand, the per cents of all response 
changes which are in the “Cannot Say” 
to “True” or “False” direction are from 
two to three times the proportions which 
the “Cannot Say” responses are of all 
original responses. From this data, it 
appears that the “Cannot Say” responses, 
which are not scored on any of the 
MMPI scales, are considerably less stable 
than the “scorable” “True” and “False” 
responses. This finding is in agreement 
with that of Lentz (13) who found the 
proportion of “?” answers changed on 
the Bernreuter inventory to be approxi- 
mately twice the proportions of “Yes” 
and “No” answers which were changed. 
These findings indicate that any investi- 
gation of the differentiating potentiality 
of “Cannot Say” responses relative to 
certain classes of psychiatric patients 
would most likely show such responses 
to reflect variable rather than stable as- 
pects of the personality. The average pro- 
portion of changed responses which are 
in the “Cannot Say” to “True” or 
“False” direction is 10.0 per cent for the 


four clinical groups: this value may be 
compared with one of 12.9 per cent for 
the normals. There is no indication that 
therapy-induced changes in personality 
are reflected in an increased tendency 
for originally uncertain attitudes to be- 
come either positive or negative. 

The means and standard deviations 
for the number of item-responses 
changed per individual for each of the 


TABLE 8 


MEANS AND STANDARD DEVIATIONS FOR NUMBER 
oF ITEM-RESPONSE CHANGES PER INDIVIDUAL 


Group N M o 

Normals 42 14-4 23.6 

OPD 25 108.6 33.0 

PN 24 106.5 29.4 

PS-NS 13 151.6 61.6 

PS-S 20 151.6 37-3 
F-values 


Group OPD PN PS-NS PS-S 


Normals 2.0 1.6 2.6* 

3.6* 

PN 4.6* 1.6 

PS-NS 2.8 
t-values 


* Significant at 1% level. 


groups is given in Table 8. The means 
for the two subgroups of normals were 
71.37 and 77.04 respectively, with stand- 
ard deviations of 19.36 and 26.24. The 
differences between the means and vari- 
ances of these two subgroups is not sig- 
nificant (¢t = 2.424; F = 1.818). Again, 
as was noted for the over-all per cent of 
responses changed, there is a remarkable 
similarity of the OPD and PN groups 
and of the PS-NS and PS-S groups with 
respect to the mean number of responses 
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changed per individual. The mean for 
; the Normal Group is significantly less 
a than that of the OPD group and also 

significantly smaller than that of the PN 
group. The variances of the PS-NS and 
PS-S groups differ significantly from that 


TABLE 9 
PERCENT OF ITEM-RESPONSES CHANGED PER GENERAL CATEGORY OF ITEM FOR EAcH Group* 
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the general categories of items, as orig- 
inally classified by the MMPI authors, 
was determined for each of the groups. 
These data are given in Table g, to- 
gether with the rank of each category 
for frequency of response change within 


Normals 


Category 


7 
7 
4 
.2 
F .8 (20.5) 
.0 (7.5) 
(2) 
.4 (16) 
XI 10.6 (18) 20.0 (15) 
XII 22.4 (1) 22.4 (14) 
18. 23.8 (10 
XV 16.4 (23) 
XVI 21.0 (2) 23.6 (11) 
XVII 17.6 (7) 23.5 (12) 
25-3 (4) 
-9 (4) 24.8 (6) 
I (11) 17.6 (19) 
.4 (21) 16.1 (24) 
.5 (10) 23-9 (9) 
.6 (15) 12.0 (25) 
-7(3) 25.0 (5) 
5 (20) 16.8 (20.5) 


23.3 (9.5) 29. 

27.7 (3) 23. 

19.2 (17) 32.3 (8.5) 
21.9 (13) 
15.4 (22) 29-3 (17) 
27.1 (4) 36.3 (2) 
23.1 (22) 
26.0 (5) 29.8 (15) 
17-3 (19) 31.2 (11) 
21.6 (15) 
23-3 (9-5) 30.8 (12.3) 
23.0 (11) 30.8 (12.3 
34-6 (3) 
16.1 (20) 32.3 (8.5 
15.9 (21) 29.5 (16) 
30.2 (14) 
10.1)(25 19.8 (23) 
25.3 (6) 33-3 (6) 
15.0 (23) 16.4 (24) 


responses within each clinical group. 


of the normals and hence testing of the 
related mean differences is not applica- 
ble. The mean for the OPD group does 
not differ significantly from that of the 
PN group, and the means of the PS-NS 
and PS-S groups do not differ signifi- 
cantly. The PS-S group mean is signifi- 
cantly larger than that of either the OPD 
or the PN group. 

In an attempt to determine whether 
there were any group differences in the 
pattern of response-changes in terms of 
the general types of items, the percentage 
of item-responses changed in each of 


each are as follows: 


Il. 


General Health (g items). 

General Neurologic (19 items). 

. Cranial Nerves (11 items). 

. Motility and Coordination (6 items). 

. Sensibility (5 items). 

. Vasomotor, Trophic, Speech, Secretory 
(10 items). 

. Cardiorespiratory (5 items). 

. Gastrointestinal (11 items). 

. Genitourinary (6 items). 

. Habits (20 items). 

. Family and Marital (2g items). 

. Occupational (18 items). 

. Educational (12 items). 


* The figures in parentheses give the ranks of the categories in the order of frequency of changed 


each of the groups. The general categories 
plus the number of items classified in 


e 
| 
PN | PSNS | PS-S 
) 21.8 (14) 31.6 (10) 38.3 (2) 
24.3 (7) 30.8 (12.3) 30.8 (10) 
34-3 (4) 25.0 (18.3) 
31.9 (2) 37-2 (1) 25.8 (16.5) 
35.8 (1) 29.2 (18.5) 32.0 (8) 
22.5 (12) 26.2 (20) 27.0 (14) 
19.0 (23) 
25.0(18.3) 
21.0 (22) 
30.3 (12) 
23.7 (21) 
25.0(18.3) 
31-3 (9) 
25.8 (16.5) 
30.7 (11) 
34-5 (5) 
2 34-7 (4) 
34-0 
29.0 (13) 
26.1 (15) 
34-3 (6) 
18.6 (24) 
35-3 (3) 
23.7 (20) 
IV 
VI 
VII 
Vill 
IX 
XI 
XII 
xy 


ory 
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XIV. Sexual Attitudes (19 items). 
XV. Religious Attitudes (20 items). 

XVI. Political Attitudes—Law and Order (46 
items). 

XVII. Social Attitudes (72 items). © 

XVIII. Affect, Depressive (32 items). 

XIX. Affect, Manic (24 items). 

XX. Obsessive, Compulsive (15 items). 

XXI. Delusions, Hallucinations, Illusions, Ideas 
of Reference (31 itemy). 

XXII. Phobias (29 items) 

XXIII. Sadistic, Masochistic (7 items). 

XXIV. Morale (33 items). 

XXV. Items modeled after suggestions of Hart- 
shorne, May and Shuttleworth to indi- 
cate whether the individual is trying to 
place himself in an improbably accept- 
able or unacceptable light (15 items). 


Application of the 7?-technique revealed 
no significant difference in the distribu- 
tions of frequencies of response changes 
per general category for the two sub- 
groups of normals (7? = 27.34; P > .30). 

While the most “unstable” categories 
in the normal subjects are XII (Occupa- 
tional) and XXIV (Morale), those with 
greatest frequency of response change in 
the OPD and PN groups are IV (Motility 
and Coordination) and V (Sensibility). 
Greatest frequency of change for the PS- 
NS and PS groups is in XII (Occupa- 
tional). There is no clear differential pat- 
tern of frequency of response change per 
category of item. In general, the first 
nine categories, those dealing with physi- 
cal symptomatology of the various organ 
systems, Category XVIII (Affect, Depres- 
sive) XXI (Delusions, Hallucinations, II- 
lusions, etcs.) XXII (Phobias), and XXV 
(the “L” scale items) show a considerably 
greater frequency of response change in 


the clinical groups than characterizes the 
normals, 


C. Irem CHANGE IN RELATION TO 
ScorRE CHANGE 


— In order to make an appraisal of the 
relationship between the amount of 
item-response change and the degree of 


profile change, the profiles of the three 
individuals having the largest number 
of item-response changes in each group 
were studied together with the profiles 
of the three individuals with the smallest 
numbers of response changes. It was at 
once apparent that no close relationship 
existed between the number of item re- 
sponses changed and the degree of pro- 
file change. 

This brief examination suggested that 
there were individual differences and 
probably group differences in the rela- 
tive specificity of item changes with re- 
spect to profile changes which might be 
interpreted as reflecting therapeutic 
progress. It was thought advisable to de- 
vise a measure of the relationship of 
item-change to scale-score change and to 
study the distribution of this measure in 
each of the special groups. The measure 
used for this purpose was simply the 
ratio of the total number of item-re- 
sponses changed per individual to the 
total amount of change, without regard 
to sign, in the raw scores on the clinical 
variables. Table 10 reports the means 
and standard deviations of this ratio for 
the normals and for each of the clinical 
groups. 

Since only 213 of the 495 items of the 
MMPI included in this study are scored 
on any of the eight psychiatric variables 
covered by those items (Hs, D, Hy, Pd, 
Pt, Sc, and Ma), only 43 per cent of item 
changes would be expected to be re- 
flected in scale score change. Thus, for 
every 10 item-responses changed, a min- 
imum change of 4.3 score points would 
be expected on the clinical scales, if the 
changes in item-response were random or 
chance. If, on the other hand, the item- 
changes were in response to particular 
therapeutic efforts directed at the devia- 
tions measured by certain of the psychia- 


; 

y 

n 

) 

) 

ed 

les 
in 
3 


20 


tric scales, the ratio of item-change to 
score-change should be lessened, i.e., a 
given number of item-changes should 
result in a greater amount of scale-score 
change than is true for normals. 

The findings are reported in Table 10. 

The Normal Group shows a mean 
ratio of item-change to score-change 


TABLE 10 


MEANS AND STANDARD DEVIATIONS FOR RATIO 
oF NUMBER OF ITEMS CHANGED TO AMOUNT 
OF SCORE CHANGE 


Group N o 
— 42 4.0 2.5 

25 3-3 1.0 
PN 24 3-2 1.2 
PS-NS 13 3-4 1.4 
PS-S 20 3-4 1.7 


F-values 


Group OPD PN PS-NS PS-S 


Normals 5.8* 3.8* 3.0 2.1 
OPD 1.5 1.9 2.6 
PN 1.2 1.8 
PS-NS 1.4 


t-values 


Group OPD PN PS-NS PSS 


Normals 2.6* 3.6* 
OPD 1.3 of -4 
PN I.1 
PS-NS .0 


* Significant at the 1% level. 


which is just about what is to be ex- 
pected by chance. The means for the 
clinical groups are smaller, indicating an 
increasing specificity of item-change, an 
increasingly higher proportion of scale- 
score items among those which are 
changed. The mean ratios for the PS-NS 
and PS-S groups are significantly smaller 
than that for the Normal Group. The 
difference between the mean ratios of the 
OPD and PN groups is not significant 
nor is that between the means of the 
PS-NS and PS-S groups. 
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One sees, then, that neurotic and psy- 
chotic patients undergoing various thera- 
pies not only tend to change a signifi- 
cantly greater number of their item-re- 
sponses than do normals (Table 8), but 
that their response changes show a signifi- 
cantly greater concentration of items 
which are scored on the psychiatric scales 
of the MMPI. We have in this data posi- 
tive evidence of the potential validity of 
the MMPI for the measurement of thera- 
peutic effects. At the same time, the lack 
of close relationship between over-all 
amount of item change and _ profile 
change argues for caution in the inter- 
pretation of profile changes. For ex- 
ample, if an alcoholic takes the MMPI 
when not fully recovered from the gen- 
eral confusional and somatic effects of a 
severe drinking bout and repeats the in- 
ventory later with a more clear sensor- 
ium, one would expect a very large num- 
ber of response changes and probably 
considerable profile change. No matter 
how extensive the profile changes might 
be under these conditions, they should 
not be interpreted as evidence of a 
change in personality but rather as evi- 
dence of recovery from an acute disturb- 
ance of certain perceptual-cognitive and 
somatic functions. Thus, if the F-score of 
the original profile were very high, it 
need not necessarily invalidate the pro- 
file in the usual sense, but rather might 
better be interpreted as indicating that 
the clinical profile reflects an acute dis- 
turbance and does not typify the individ- 
ual’s basic personality. If, on the other 
hand, this same person were tested and 
retested when fully sober, over an in- 
terval in which intensive psychotherapy 
had been attempted, an equally exten- 
sive change in his MMPI profile might 
be found to result from a change in re- 
sponse to considerably fewer items than 
were changed in the above example. 


|_| 

| 
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True personality changes as reflected in 
profile changes should mean a greater- 
than-chance frequency of change of 
those items which yield scale scores. 


D. CHARACTERISTICS OF THE Most STABLE 
ITEMS AND THE Most VARIABLE ITEMS 
IN EAcH Group 


Since the variability of the items (per- 


centage of responses per item changed) 
shows a large range in each of the groups 
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found on the F and Sc scales. A similar 
relationship, concentration of the most 
stable items on the F and Sc scales, holds 
in each of the four clinical groups. 

No equally consistent pattern is found 
among the groups for the most variable 
items. In the normals and PS-NS groups, 
the Hy scale has the highest concentra- 
tion of variable items. In the PN group, 
the Hy and Sc scales have the highest— 
and equal—concentrations of variable 


TABLE 11 


PERCENTAGE DISTRIBUTIONS, BY SCALE, OF THE SCORES YIELDED BY THE Most STABLE AND 


BY THE Most VARIABLE ITEMS FoR EACH Group 


No. Tot. Percent of Total Scale-Score Per Scale 
Group Item of oun Scale 
Type | Items we] Score| L | F | K | Hs | D | Hy | Pa | Mf | Pa | Pt | Sc | Ma 
Stable 2 ° 8 5-3 | 34-2 5-3 | 5-3 | 7-9 | 2.6 | 2.6 |n0o.5 | 5.3 |18.4 2.6 
Normal | Variable 28 35-0+ 35 4.0 |20.0 8.0 |24.0 |12.0 | 4.0 |12.0 | 4.0 12.0 
Stable 30 o-4 - 39 5.4 | 48.7 2.6] 2.6 | 2.6 | 7.7 12.8 17.9 
OPD Variable| 37 | 4o.0+| 31 16.1 9.7 | 9.7 \16.1 | 9.7 |r2. 
Stable 49 o-4.2 55 3-6 | 47-3 1.8 | 1.8 | 1.8 | 5.5 | 1.8 |10.9 | 1.8 [23.6 
PN Variable 33 45 2.3 4-4 |17.8 | 8.9 | 4.4 | 6.7 |17.8 4-4 
Stable 28 | o-7.7 31 9-7 | 22.6 6.5 | 9.7 | 9-7 | 3.2 |12.9 6.5 |16.0 3.2 
PS-NS | Variable| 37 | 53.8+| 35 14.3 8.6 |17.0 |x4.3 | 2.9 | 8.6 | 5.7 | 14.3 
Stable 20 | os 30 | 6.7 | 53-3 6.7 6.7 | 3-3 |23-3 
PS-S Variable} 32 | ss.o+| 37 | 5-4 | 8.1 21.6 16.3 |16.3 5-4 |10 8.1 | 8.1 


(e.g., 0-42.99 per cent in the normals), 
it was considered desirable to determine 
what differences might characterize the 
most stable and the most variable items 
for each distribution. Table 11 presents 
the results of an analysis of the scale 
representations of the two types of item 
in each group. Thus, it was found that 
the 27 items which had a o per cent 
change in the Normal Group (i.e., each 
individual's second response to an item 
was the same as his first response) yielded 
a total of 38 raw scale-score units.* Of the 
total amount of scale-score yielded by 
these items, the largest percentages are 


* That the number of scale-score units should 
exceed the number of items is accounted for by 
the fact that certain of the items are scored on 
more than one scale. Lists of the most stable 
items, i.e., those with “o%,” change, are provided 
in the Appendix. 


items. In the PS-S group, the D scale 
shows the highest concentration of varia- 
ble items, with the Hy and Pd scales 
showing the second highest frequency. 
In short, the F and Sc scales are marked 
in all groups by a relatively high fre- 
quency of very stable items; the variable 
items, on the other hand, are irregular 
in their scale concentration from group 
to group. In view of the stability charac- 
terizing many of the items composing 
the F and Sc scales, one would have 
reason to expect any change in the scores 
on those scales to more probably reflect 
valid personality changes rather than 
to be chance variations. 

Table 12 reports for each group the 
proportions of the most stable and most 
variable items for that group which are 
“obvious,” “subtle,” and not scored on 
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any scale. The “obvious” and “subtle” 
items are composed of all items scored 
on the D, Hy, Pd, Pa, and Ma scales of 
the MMPI and have been keyed by 
Wiener and Harmon (18) according to 
the relative ease or difficulty with which 
the nature of the socially desirable re- 
sponse may be detected. It will be noted 
that there is a consistent tendency for the 
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non-scored items in the stable and varia- 
ble items is significant for the Normal 
and OPD groups. In short, the variable 
items, as distinguished from the stable 
items, are characterized by a tendency to 
be either of a type in which the direc- 
tion of the socially desirable response is 
not readily perceptible or of a type 
which has not yielded normal-criterion 


TABLE 12 


THE PROPORTIONS OF THE Most STABLE AND Most VARIABLE ITEMS FROM EACH GROUP 
“Opsvious,” “SuBTLE,’”’ AND Not SCORED ON ANY SCALE 


The Most Stable Items 


The Most Variable Items 


No. of 
Items 


Percent 
Subtle 


Percent 
Obvious 


% Not 
Scored 


% Not 
Scored 


Percent 
Subtle 


Percent 
Obvious 


27 
30 
49 
28 
20 


25-9 
23.3 
12.2 
21.4 
10.0 


14.8 
13.3 
20.4 
28.5 
20.0 


10.7 
27.0 
27.3 
21.6 
40.6 


39.2 
16.2 
21.2 
32-4 
15.6 


47-9 
48.6 
@r.2 
30.0 
40.6 


stable items to consist of higher propor- 
tions of obvious rather than subtle items, 
with a mean difference of 15.3 per cent 
between the proportions of these two 
types of item among the stable items of 
the five groups. No such consistent tend- 
ency appears in the obvious-subtle dis- 
tributions of the variable items. In com- 
paring the stable and variable items, no 
consistent group-to-group relationship 
appears with respect to the frequency of 
obvious items. However, in all groups, 
the variable items show higher propor- 
tions of subtle items than are found in 
the stable items, and for the Normal and 
PS-NS groups the differences between the 
proportions of subtle items in the stable 
and variable items respectively are signif- 
icant (P < .o1), Furthermore, there is a 
consistent tendency for the variable 
items to have a higher proportion of 
items which are not scored on any scale 
than is true for the stable items, and the 
differences between the proportions of 


critical ratios sufficiently large to result 
in their selection for scoring on any of 
the existing MMPI scales. That items 
having a high frequency of changed re- 
sponses upon repetition with a given 
group should show these characteristics 
is to be expected both from the psychol- 
ogy of that behavior which is variable 
and from the nature of item-selection. 
Thus, there are areas of behavior the 
“subtlety” of which is expressed by the 
absence of any clear-cut, readily recog- 
nized pattern of response in the group 
which may serve as a constant standard 
against which the individual can evalu- 
ate or regulate his own conduct. In the 
absence of such social norms, the indi- 
vidual is required to “project” norms 
which vary as a function of recent experi- 
ence and memory of last response in a 
similar situation. The element of 
uniqueness in all experience plus the 
fallibility of memory makes directly for 
variability of response in the individual. 


No. of 
PS-NS 3.6 37 
PS-S 0.0 32 


This variability expresses itself in the 
group by an absence of a given response 
in sufficient frequency to characterize 
that group in statistical comparison with 
another group. 

As an aside, it might be proposed that 
the ideal questionnaire should be com- 
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ing effects to operate in such a way that 
they may be measured, rather than 
naively assuming that they have been 
circumvented by a clever ruse. 

Further study of the stable and varia- 
ble items was made in an effort to dis- 
cover any distinguishing characteristics 


TABLE 13 
THE PROPORTIONS OF ITEMS INVOLVING FREQUENCY ESTIMATES AND ITEMS Not INVOLVING 


Sucu ESTIMATES IN THE STABLE AND VARIABLE ITEMS OF EACH GROUP 


Group Type of Item 


No. of Items 


Ratio of No. 
of Non-Freq. 
to Freq. Items 


% With Freq. 
Estimate 


% Without | 
Freq. Estimate 


Normal Stable 27 
Variable 28 
OPD Stable 30 
Variable 37 
PN Stable 49 
Variable . 33 


Stable 28 
Variable . 37 


PS-S Stable 20 
Variable 32 


23.1 76.9 3-33 
33-3 66.7 2.00 
16.7 82.3 5.00 
40.5 59-5 1.47 
14.3 85.7 6.00 
38.2 61.8 1.62 


31.0 69. 
37.8 62. 


n 


-33 
1.64 


10.0 
28.1 71.9 


no 


posed solely of items of the subtle variety 
which require the subject to “project” 
his own norms, thus gaining for the per- 
sonality inventory the highly regarded 
virtues of the projective techniques. 
There are at least two answers to this 
proposal. In the first place, the variabil- 
ity in response to such items, as has been 
indicated in this study, would suggest 
that they might seriously detract from 
the effort to establish reliable relation- 
ships between the test measures and 
given criteria. Secondly, recognizing that 
there are attitudes peculiar to the process 
of test-taking which are different from 
the particular attributes we are inter- 
ested in measuring and which have cer- 
tain distorting effects on the latter, there 
would seem to be some inherently scien- 
tific cogency to permitting such distort- 


that might not have appeared in the 
above statistical analyses. Other studies 
(10) have indicated that items involving 
an estimate of frequency by the subject 
(e.g., “much of the time,” “seldom,” etc.) 
have higher rates of change than items 
not requiring such estimates, An analy- 
sis was made of the occurrence of these 
two types of item among the stable and 
variable items of each of the groups in 
the present investigations, with the re- 
sults reported in Table 13. A consistent 
tendency was found for the stable items 
of each group to have a higher propor- 
tion of items not involving an estimate of 
frequency than was true for the variable 
items. For the stable items from all 
groups, the mean ratio of the number of 
items not involving an estimate of fre- 
quency to the number of items involving 
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such an estimate was 5.13; for the varia- 
ble items, the comparable mean ratio 
was 1.86. It appears from this that there 
is a distinct tendency for those items in 
which the subject must make some esti- 
mate of frequency of occurrence of a 
behavior in himself or others (e.g., “I 
feel weak all over much of the time,” or 
“I believe I am no more nervous than 
most others”) to be more variable in the 
responses they elicit from the same indi- 
viduals than are the items not requiring 
such estimates. 

In a study of the relationship of vari- 
ability of items and the degree to which 
they were stated in present or past tense, 
no consistent group-to-group tendency 
was found. In three of the five groups 
(Normal, PN, and PS-S), the variable 
items yielded a higher ratio of “number 
of items in the present tense” to “num- 
ber of items in the past tense” than did 
the stable items. In the other two groups 
(OPD and PS-NS), this relationship was 
reversed, the stable items yielding a 
higher ratio of present-tense to past- 
tense items. The mean of these ratios in 
the five groups was 4.10 for the stable 
items and 8.10 for the variable items. As 
might be expected, those items involving 
a memory of past occurrences appear 
more frequently among those items to 
which responses are quite stable, while 
those items involving present situations, 
moods, and pressures appear more fre- 
quently among those items to which re- 
sponses are changed. However, the varia- 
bility in the relative concentration of 
present-tense and past-tense items among 
the stable and variable items from group 
to group suggests that the relationship 
between the “time” factor of an item and 
its stability or variability is not a simple 
one but involves other elements. 

Finally, a study was made to deter- 
mine the relative stability of responses to 
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the so-called “double-negative” items. 
These are items which are stated in the 
negative and are scored if answered in 
the negative, that is sorted “False” (e.g., 
“I do not tire quickly’’). The stable and 
variable items from each of the five 
groups of subjects were examined to 
determine the number of double-nega- 
tive items they included. This survey of 
the 154 stable and 157 variable items 
yielded a total of 33 items of the double- 
negative variety. Of these 33 items, 10 
(or 30.3 per cent) were stable and the 
remainder, 69.7. per cent, were variable. 
In four of the five groups, the ratio of 
the number of double-negative items 
among the variable items to the num- 
ber among the stable items was three to 
one. In the remaining group (PS-NS), 
the ratio was one to one. 

In summary, the above analyses of the 
most stable and most variable items for 
each of the five groups of subjects have 
pointed to certain fairly consistent differ- 
entiating characteristics. The stable 
items tend to be concentrated on the F 
and Sc scales of the MMPI, to be obvious 
in nature, to involve no estimate of the 
frequency of occurrence of a given be- 
havior either in the subject or in other 
people, and to be more frequently stated 
in past rather than present tense. The 
variable items, on the other hand, tend 
to show no clear concentrations on any 
of the MMPI scales, to be subtle rather 
than obvious, to involve estimates of fre- 
quency of given behavior, and to be 
stated in the present rather than the 
past tense. 


E. INVESTIGATION OF A THERAPY- 
SUSCEPTIBLE SCALE ‘ 


It was suggested earlier in this research 
that one possible direction to be taken by 
a study of item-response changes would 
be a determination of those items which 


the 


have a significantly greater percentage of 
changed responses in persons responding 
favorably to therapy than in normals. 
Theoretically, such a scale of items 
would have both a prognostic and an 
evaluative function. For example, the 
greater the clinical score made by the 
individual on those items having a spe- 
cific tendency to change with electro- 
shock therapy, the greater the probability 
that his post-therapy responses will be in 
the non-psychiatric direction, i.e., the 
greater the probability that he will im- 
prove. It follows directly from this that 
the amount of the individual’s change 
in score on the therapy-susceptible items 
may be taken as an index of the validity 
of the overall profile change as an indica- 
tion of improvement. Profile changes in 
the favorable direction not accompanied 
by adequate changes on the items specifi- 
cally responsive to the therapy concerned 
would not be misinterpreted as evidence 
of improvement. 

It might be argued that such proposed 
scales of therapy-susceptible items should 
be composed solely of those items for 
which the frequency of change of an origi- 
nally significant response in a given ther- 
apy group was reliably greater than the 
same change in normals. Such a selection 
procedure would miss those equally vari- 
able items which happened on the first 
test to have been answered in the non- 
significant direction. Consequently, the 
following procedure was used to arrive 
at a list of “therapy-susceptible” items 
for each of the treatment groups. 

The total number of response-changes 
was determined for each item for each of 
the “improved” clinical groups (PN, PS- 
NS, PS-S) and for the combined nor- 
mals.* These frequencies were converted 


‘It has been reported previously that the x? 
technique showed no significant differences be- 
tween the two normal groups in the manner in 
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to percentages. By the use of appropriate 
nomographs (19) the reliability of the 
difference between the percentage of 
changed responses for each item in the 
Normal Group and in a given therapy 
group was determined. Only those differ- 
ences were considered reliable which 
yielded a critical ratio of 3.00 (P < .003). 
In the cases of percentage differences 
which were borderline with respect to 
the nomographs, the following formula 
was applied: 


pi-— 
~) 
Ni+N2 


By this procedure, three scales of “ther- 
apy-susceptible” items were derived. In 
terms of the arguments given above, the 
items of these scales may be considered to 
constitute a potential measure of progno- 
sis and the scales will be referred to here- 
after as the Px scales. 

Since the hospitalized neurotics ap- 
peared to be the group for which inde- 
pendent validating data could be most 
readily obtained, it was decided to study 
the prognostic effectiveness of the scale 
of items derived for this group.’ A key 
based on these items was applied to both 
MMPI records of the 24 patients in the 
PN group. Basic statistics for the Px 
scores in this group are given in Table 


which item changes were distributed over the 
twenty-five general categories of items. 

A study of the significance of the difference 
of frequency of response-change per item in the 
two normal groups revealed a total of only 15 
items which yielded differences significant at the 
5 per cent level. Of these 15 items, only 5 (1 a 
cent of the total number of items) yielded differ- 
ences significant at the 1 per cent level. In view 
of these findings, it was considered permissible 
to combine data from the two normal groups for 
the item study. 

*The twenty-four items comprising this Px 
scale, as numbered in the MMPI manual of 
directions, 1943 version, are as follows: Az, A4, 
Aig, Ai6, A46, Aq48, Bi, Bo, Biz, B14, Bis, 
B17, B28, C45, F2, F18, F49, F55, Gi, Geo, Gai, 
H46, I27. 
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14. The mean Px score on the second 
MMPI is significantly lower than that 
obtained in the first administration. 
While this is evidence of the potential 
usefulness of the Px scores for detecting 
therapeutic changes on a group basis, the 
extreme overlap of scores before and 


TABLE 14 


MEANS, STANDARD DEVIATIONS, AND 
SIGNIFICANCE TESTS FOR THE Px SCORE 
IN THE HOSPITALIZED NEUROTICS 
(PN) (N=24) 


M o Range 
ist MMPI.... 11.9 4-20 
and MMPI.... 8.1 4.8 I-21 
t=3.5 F=2.1 
P< .o1 .02 


after therapy makes it practically useless 
for individual prediction. 

In order to study the distribution of 
the Px score in independent samples, the 
hospital files were searched for cases of 
diagnosed female psychoneurotics who 
were discharged “unimproved.” Only 
thirty such cases were found and of this 
number, only nineteen had MMPI rec- 
ords. Twenty-nine cases of female psy- 
choneurotics discharged “‘improved’’ and 
having post-admission MMPI records 
were also chosen randomly from the 
files. Table 15 gives the basic statistics of 
the Px score for these two groups. 

The difference between the mean Px 
scores of the two groups is not signifi- 
cant. 

In addition to the information on 
“condition on discharge”’ for the two test 
groups, the diagnostic summary of each 
patient carried a statement relative to 
prognosis. These statements were evalu- 
ated in terms of “good,” “fair,” or “poor” 
prognosis. The y? technique revealed no 
relationship between the Px score at the 
time of admission and the prognosis on 
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discharge in either the “improved” or 
“unimproved” groups (y? = .939 and 
.254, respectively). 

In order to determine whether any 
better differentiation would result from 
the use for the Px scale of only those 
items for which the frequency of change 
of an originally significant response was 
reliably greater in the PN group than in 
the Normal Group, a key was prepared 
for the 11 items from the 24 of the first 
Px scale which satisfied this relationship. 
These items were: A-2, A-13, A-46, B-9, 
B-11, B-14, B-17, B-28, F-18, and I-27. 
The results of the application of this 
scale to the two test groups of hospital- 
ized neurotics revealed no improvement 
in differentiation over that of the orig- 
inal Px score (t = .446; F = 1.076). 

It would appear from the above data 
that the general approach to the selec- 
tion of therapy-susceptible items which 
has been followed in this study does not 
result in a valid set of items having any 
prognostic power to differentiate pa- 


TABLE 15 


MEANS, STANDARD DEVIATIONS, AND 
SIGNIFICANCE TESTS FOR THE Px SCORE 
IN SAMPLES OF IMPROVED AND 
UNIMPROVED PSYCHONEUROTICS 


M o Range 

Improved (N=29).. 10.6 4.6 3-20 

Unimproved (N=19) 8.6 5.1 o-18 
t=1.4 F=1.2 
P<.20>.10- P>.05 


tients who will improve under a given 
regimen from those who will not. This 
conclusion necessarily assumes that the 
criterion used to test the validity of such 
items was in itself a valid criterion. 
In the nine years that the Psycho- 
pathic Unit of the University Hospitals 
has been in operation, a total of 470 fe- 
male admissions has been diagnosed as 
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psychoneuroses. Of this total, only 6.4 
per cent were discharged “unimproved.” 
A recovery or improvement rate of better 
than go per cent is so much greater than 
the median value reported in the litera- 
ture that one would necessarily suspect a 
biased selection of patients, a therapeutic 
program of particular composition and 
intensity, an inaccurate evaluation of 
post-therapy status, or an admixture of 
these factors. 

Careful evaluation of the histories of 
the neurotic patients in this study and of 
the larger hospital sample of neurotics 
from which they were drawn does not 
support the hypothesis of biased selec- 
tion of case material. Review of the pro- 
cedures used in the treatment of patients 
by the Psychopathic Unit and analysis of 
the hospital regimen, aside from particu- 
lar therapeutic techniques, does not sup- 
port the hypothesis that the greater im- 
provement rate in the patients of this 
study as contrasted with those reported 
in the literature is to be accounted for by 
differences in treatment. There remains 
the probability that the high frequency 


of improved patients chiefly reflects 
errors of omission in the clinical evalua- 
tion of the status of patients and the 
amount of their change at the time of 
discharge. Support to this point is given 
by a readmission rate of 10.5 per cent for 
the female neurotics. 

A more objective determination of the 
post-therapy status of patients than is 
usually available is greatly to be desired. 
Such determination ultimately must re- 
side in the clinical judgment of the psy- 
chiatrist. To the extent that the psychia- 
trist can be encouraged to orient his post- 
therapy evaluation of a patient to a re- 
lationship with the factors underlying 
his assay of pre-therapy status, he will 
provide a valid clinical criterion. With 
such a criterion available, it will be possi- 
ble for research techniques to establish 
independent prognostic and evaluative 
measures which will not only have value 
in the consideration of the individual 
patient but will provide even more im- 
portant objective checks on the efficacy 
of specified therapeutic efforts. 
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His stupy has had three goals: to 
determine the nature and _ signifi- 
cance of changes in the MMPI profiles of 
groups of psychiatric patients receiving 
certain therapies, to study the extent and 
nature of item-response changes in these 
clinical groups and to contrast them with 
those found in normals, and, finally, to 
attempt the selection and testing of a 
group of therapy-susceptible items. 

A check of the approximately 7000 
records in the MMPI research files at the 
University of Minnesota yielded a total 
of 124 cases for which two profiles were 
available and which met the other cri- 
teria for this study. These cases were dis- 
tributed as follows: normals, 42; out- 
patients, 25; hospitalized neurotics, 24; 
hospitalized psychotics not treated with 
any type of shock therapy, 13; hospital- 
ized psychotics given electroshock ther- 
apy, 20. All in-patients included in the 
sample had been discharged “improved” 
or “recovered” and the two MMPI pro- 
files had been obtained within the limits 
of a single hospitalization. Since it was 
not possible to find a sufficient number 
of male cases, the samples were composed 
entirely of females. 

The sample of psychotic patients 
treated with electroshock, though a very 
mixed group, was composed largely of 
depressions and involutional melan- 
cholias. The average number of grand 
mal treatments received by these patients 
was between six and seven, and the in- 
terval between their two MMPI’s was 
slightly less than one month. This group 
showed a significant post-shock reduc- 
tion of their mean scores on all of the 
MMPI clinical scales with the exception 


CHAPTER IV 


SUMMARY AND CONCLUSIONS 


of Masculinity-Femininity and Hypo- 
mania. Those means which were highest 
before therapy in this group were on the 
Depression, Psychopathic Deviate, Psy- 
chasthenia and Schizophrenia scales, and 
it was on these scales that greatest change 
occurred. 

The sample of hospitalized neurotics 
had a mean initial profile practically 
identical with that of the out-patient 
sample. However, after a mean interval 
of approximately one month, the same as 
the median interval for the out-patient 
group, the profile for the hospitalized 
neurotics showed a significant decrease of 
the Hypochondriasis, Hysteria and Psy- 
chopathic Deviate scores. It must be re- 
membered that all patients in the three 
hospitalized groups were discharged as 
“improved” or “recovered.” It may be 
concluded that improvement in the per- 
sonality pattern of neurotics under the 
general regimen of the psychiatric ward 
is shown in a significant reduction of 
hypochondriacal and hysterical symp- 
tomatology as measured by the MMPI. 
Apparently, this form of therapy does 
not suffice to reduce any marked degree 
of depression as reflected in the Multi- 
phasic “D” score. The ineffectiveness of 
hospitalization alone to cure depressive 
states in a neurotic syndrome can only be 
judged with respect to the interval of 
intramural therapy represented in our 
sample, namely, approximately one 
month. 

Within the limits of our small sample 
of psychiatric out-patients and the nature 
and number of psychiatric interviews in- 
tervening between the collection of the 
two MMPI records, it would not appear 
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that out-patient therapy of the type 
afforded by the University Clinic suffices 
to affect a significant change in the mean 
scores of such patients on any of the 
clinical scales. The out-patient sample 
consisted almost wholly of psychoneurot- 
ics of mixed type who had an average of 
five clinic visits between their tests. No 
clinical evaluation of the nature of their 
response to therapy was available. The 
data of this study would indicate that 
such patients require more intensive 
therapy than that afforded by the out- 
patient clinic or a greater number of 
therapy interviews (or both) before they 
will show a favorable response. This con- 
clusion is presented with certain reserva- 
tions. It may be argued that improvement 
in the out-patient group occurred in 
areas of attitude, self-evaluation, and 
personal relationship not sampled by the 
MMPI. It may further be argued that 
the validity of the MMPI as a measure of 
therapeutically derived changes in per- 
sonality has not been sufficiently estab- 
lished to warrant its application as the 
sole criterion in evaluating such changes. 
However, in the absence of other criteria 
and with consideration for the validity 
of the MMPI as a picture of the patient’s 
pre-therapy status, the data of the pres- 
ent study do not yield evidence of im- 
provement in the psychiatric status of 
the out-patients. 

With respect to the proportion of 
item-responses changed, it was found 
that all of the clinical groups changed a 
larger percentage of their responses than 
was true for the normals, who changed 
only 14 per cent of their responses. Both 
groups of neurotics changed approxi- 
mately 20 per cent of their responses, 
while the two psychotic groups gave a 
30 per cent response change. Aside from 
the fact that the clinical groups show a 


greater variability than the normals in 
their responses, it is of considerable 
interest that both groups of neurotics 
show essentially the same rate of change 
in spite of marked differences in treat- 
ment, and that both psychotic groups 
likewise show a nearly identical mean 
frequency of response change in spite of 
the marked differences in the therapy 
they received. These findings suggest a 
characteristic rate of variability for nor- 
mals, for neurotics, and for psychotics 
which is relatively independent of en- 
vironmental stresses, although the items 
on which the variability is based are dif- 
ferent. On a stability-of-response con- 
tinuum, the neurotics would fall be- 
tween the normals and the psychotics, 
somewhat closer to the normals. Further 
investigation of this finding might yield 
a useful technique for solving borderline 
neurotic-psychotic differentiations. 

It has been shown that for normals 
and for groups of neurotics and _psy- 
chotics, “Cannot Say” responses have a 
considerably higher rate of change than 
is found for either “True” or “False” 
responses. The proportion of all changed 
responses contributed by changes in 
original “Cannot Say” responses is from 
two to three times greater than the pro- 
portion which “Cannot Say’ responses 
are of all original responses. The greater 
variability of the “Cannot Say” re- 
sponses suggests that such responses may 
occur on items which pertain to com- 
ponents of personality which are “valid- 
ly” variable rather than stable. 

By selecting cases from the extremes of 
the distributions of number of items 
changed per individual, it was demon- 
strated than no simple relationship 
holds between the total number of item- 
responses changed and the amount of 
scale-score change effected. Marked 


e 

d 

e 

y 
it 

: 

is 

it 

d : 

of 

e- 

€ 

r- 

d 

of 2 
I. 

e 
i- 

of 

e 

of 

ir 
le 

re 


30 WILLIAM SCHOFIELD 


changes in profile may be accomplished 
by individuals who have changed rela- 
tively few items, whereas other indi- 
viduals may change a_ considerably 
greater number of items and yet show 
very little profile change. 

This finding led to a study of the 
ratio of the number of items changed to 
the total amount of change in scale- 
score for the members of each of the 
groups. As a result of this investigation, 
it was discovered that the clinical groups 
not only change a significantly greater 
number of items than do normals, but 
that the items they change include a sig- 
nificantly greater concentration of scored 
items, i.e., items contributing to a score 
on at least one scale of the MMPI. This 
finding is considered evidence of the sen- 
sitivity of the MMPI to therapy-induced 
changes in personality. 

While the most stable items for each 
of the groups, normal and clinical alike, 
tended to be concentrated in the F and 
Schizophrenia scales, no similar pattern 
of concentration on any scale or scales 
characterized the most variable items. 

With respect to the “obvious” or 
“subtle” qualities of the items, stable 
items for each group were much more 
often obvious than subtle. No similar re- 
lationship was found for the most vari- 
able items, but these items were much 
more frequently not scored on any of the 
MMPI scales than were the stable items. 
The tendency for the most variable 
items to be more commonly not scored 
on any of the scales probably reflects the 
fact that when item selection is on the 
basis of group differentiation at a given 
time, items which pertain to the more 
subtle and fluctuating aspects of per- 
sonality, and hence on which there would 
be no marked agreement by a given 
group, are missed. 


The attempt to derive a scale of items 
which would both predict the response 
of a given type of patient to a given 
therapy and measure the amount of per- 
sonality change to be attributed to that 
therapy was not successful. By selecting 
those items with a frequency of response- 
change reliably greater in an improved 
patient-therapy group than in normals 
and by keying such items for the psy- 
chiatrically significant response, it was 
believed that the resultant scale would 
yield scores with a positive relationship 
to prognosis, high scores being associated 
with good prognosis and low scores with 
poor. Whe scale derived by this approach 
for the hospitalized neurotics was ap- 
plied to both sets of MMPI records for 
this group. In accordance with the as- 
sumptions about the therapy-measuring 
potential of such a scale, the mean score 
of the post-therapy records for the hos- 
pitalized  neurotics was significantly 
lower than that of the pre-therapy rec- 
ords, although there was a marked de- 
gree of overlap in the two distributions 
of the score, over a fifth of the post- 
therapy scores being above the mean of 
the pre-therapy distribution. 

Application of the therapy-susceptible 
scale for hospitalized neurotics to inde- 
pendent samples of patients discharged 
“improved” and “unimproved” respec- 
tively yielded no differentiation. It was 
pointed out in this connection that the 
extreme rarity of hospitalized neurotics 
who were discharged “unimproved” 
would give reason to question the valid- 
ity of the “improved-unimproved”’ cri- 
terion. Within both the “improved” and 
“unimproved” groups no relationship 
was found between the score on the 
therapy-susceptible scale at time of ad- 
mission and the prognosis at time of 
discharge. 
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Several lines of research are suggested 
by the results of this study. It is obvious, 
of course, that the analyses reported here 
should be repeated for data on males. 
With respect to the detection of non- 
specific profile changes and their dis- 
crimination from therapy-reflecting 
changes, further study of the henenhe- 
istics of profiles for people with high and | 
low ratios of number of items changed 
to amount of score change should be 
made. The frequency of item-response 
changes in other samples of neurotics 
and psychotics should be determined as 


a check on the hypothesis that there is a 
characteristic rate of variability in these 
groups which might be used as a differen- 
tial sign. 

The problem of developing a prog- 
nostic scale for the MMPI would appear 
to be seriously hampered by the lack of 
a reliable clinical criterion of patients’ 
responses to therapy. Until a technique 
may be developed whereby the “condi- 
tion on discharge” will carry more exact 
meaning than it appears to currently, 
scales to predict response to therapy will 
be very difficult to validate. 
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APPENDIX 


THe Most STABLE ITEMs IN EAcH Grour* 

A. THE TWENTY-SEVEN ITEMS WITH C. THE FIFTEEN ITEMS WITH “o%” 
“o%” CHANGE IN THE COMBINED NOR- CHANGE IN THE HOSPITALIZED NEU. 
MALS (N = 42): ROTICS (N = 24): 

A11, Aig, Ago, A46, Bs, B32, B46, Cig, C14, Cg, Ci4, C46, C52, Dai, Des, D4g, Ezz, 
C36, C49, Deg, E37, Gi, G35, H4, H14, E25, H8, Hi5, Heo, Hee, H24, H41. 
H15, Hao, Hai, H22, H25, H48,17, J50, D. THE SEVEN ITEMS WITH “o%” CHANGE 


J53- IN THE “NON-SHOCK” PSYCHOTICS 
B. THE TWELVE ITEMS WITH “o%” (N = 18): 


CHANGE IN THE OUT-PATIENT GROUP E15, E2o, Egg, H38, Ig, J48, J51, J53- 

(N = 25): E. THE SIX ITEMS WITH “o%,” CHANGE IN 
A51, D4g, E21, E22, G44, G53, H14, H15, THE “SHOCKED” PSYCHOTICS (N = 20): 
Hao, H27, J45, J48.- C11, Ci4, C52, D28, H24, Ig. 

*The items are numbered as in the MMPI 
manual of directions, 1943 version. 
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